Topology-Aware Strategy for MPI-IO Operations in Clusters

Reliable MPI-IO through Layout-Aware Replication

The current deployment of petascale systems and the promise of future exascale systems have created unprecedented challenges in how to manage failures in such systems. While many parallel file systems provide some sort of redundancy mechanism to cope with failures, such systems rely heavily on a hardware-based solution such as RAID. In this paper, we propose a block replication approach to stor...

Portable Topology-Aware MPI-I/O

Utilizing In-Memory Storage for MPI-IO

In contrast to disk or flash based storage solutions, throughput and latency of in-memory storage promises to be close to the best performance. Kove®’s XPD® offers pooled memory for cluster systems. However, the system does not expose access methods to treat the memory like a traditional parallel file system that offers POSIX or MPI-IO semantics. Contributions of this poster are: 1. Implementat...

Chapter 13 MPI - IO

13.

Multi-core and Network Aware MPI Topology Functions

MPI standard offers a set of topology-aware interfaces that can be used to construct graph and Cartesian topologies for MPI applications. These interfaces have been mostly used for topology construction and not for performance improvement. To optimize the performance, in this paper we use graph embedding and node/network architecture discovery modules to match the communication topology of the ...